Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

8-bit precision

Inference Endpoints

text-generation-inference

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

2,276

Full-text search

Active filters: quantized

Gapeleon/bytedance_BAGEL-7B-MoT-INT8

Any-to-Any • Updated 7 days ago • 354 • 22

meimeilook/BAGEL-7B-MoT-FP8

Any-to-Any • Updated 3 days ago • 11

RedHatAI/Llama-4-Scout-17B-16E-Instruct-FP8-dynamic

Image-Text-to-Text • Updated 2 days ago • 9.39k • 19

boltuix/NeuroBERT-Tiny

Text Classification • Updated 10 days ago • 208 • 10

jedisct1/MiMo-7B-RL-GGUF

Updated Apr 30 • 18.8k • 21

boltuix/NeuroBERT-Small

Text Classification • Updated 10 days ago • 193 • 9

boltuix/NeuroBERT

Text Classification • Updated 10 days ago • 389 • 9

boltuix/NeuroBERT-Pro

Text Classification • Updated 10 days ago • 196 • 9

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22, 2024 • 288k • 99

Tonic/GemmaX2-28-2B-4bit

Translation • Updated Feb 26 • 51 • 3

nvidia/Llama-4-Maverick-17B-128E-Instruct-FP8

Updated 3 days ago • 100 • 2

RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w4a16

Image-Text-to-Text • Updated 2 days ago • 1.26k • 4

RedHatAI/Qwen3-30B-A3B-quantized.w4a16

Text Generation • Updated 19 days ago • 624 • 3

boltuix/NeuroBERT-Mini

Text Classification • Updated 10 days ago • 285 • 10

mradermacher/NeuroBERT-Mini-GGUF

Updated 9 days ago • 277 • 2

MaziyarPanahi/DeepSeek-R1-0528-Qwen3-8B-GGUF

Text Generation • Updated 3 days ago • 16.2k • 2

RedHatAI/DeepSeek-R1-0528-quantized.w4a16

Text Generation • Updated about 1 hour ago • 83 • 2

MaziyarPanahi/SciPhi-Self-RAG-Mistral-7B-32k-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26, 2024 • 61 • 3

qualcomm/ControlNet

Unconditional Image Generation • Updated Apr 9 • 98 • 9

qualcomm/Posenet-Mobilenet-Quantized

Keypoint Detection • Updated Apr 9 • 129 • 5

legraphista/shieldgemma-9b-IMat-GGUF

Text Generation • Updated Aug 5, 2024 • 212 • 1

MaziyarPanahi/Yi-Coder-1.5B-Chat-GGUF

Text Generation • Updated Sep 4, 2024 • 224k • 10

argmaxinc/whisperkit-pro

Automatic Speech Recognition • Updated Apr 24 • 2.22k • 14

RedHatAI/Llama-3.3-70B-Instruct-FP8-dynamic

Text Generation • Updated 2 days ago • 4.86k • 6

MaziyarPanahi/Mistral-Small-24B-Instruct-2501-GGUF

Text Generation • Updated Jan 30 • 274k • 5

MaziyarPanahi/Slush-ChatWaifu-Chronos-GGUF

Text Generation • Updated Feb 10 • 35 • 1

MaziyarPanahi/gemma-3-12b-it-GGUF

Text Generation • Updated Mar 12 • 242k • 10

MaziyarPanahi/gemma-3-27b-it-GGUF

Text Generation • Updated Mar 16 • 227k • 5

MaziyarPanahi/ReasonFlux-F1-14B-GGUF

Text Generation • Updated Mar 24 • 25 • 1

RedHatAI/DeepSeek-R1-quantized.w4a16

Text Generation • Updated Apr 22 • 187 • 6